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Abstract 

Background: The move to frame medical education in terms of competencies - the extent to which trainees 
"can do" a professional responsibility - is congruent with calls for accountability in medical education. However, 
the focus on competencies might be a poor fit with curricula intended to prepare students for responsibilities 
not emphasized in traditional medical education. This study examines an innovative approach to the use of 
potential competency expectations related to advancing global health equity to promote students' reflections 
and to inform curriculum development. 

Methods: In 2012, 32 medical students were admitted into a newly developed Global Health and Disparities 
(GHD) Path of Excellence. The GHD program takes the form of mentored co-curricular activities built around 
defined competencies related to professional development and leadership skills intended to ameliorate health 
disparities in medically underserved settings, both domestically and globally. Students reviewed the GHD 
competencies from two perspectives: a) their ability to perform the identified competencies that they perceived 
themselves as holding as they began the GHD program and b) the extent to which they perceived that their 
future career would require these responsibilities. For both sets of assessments the response scale ranged from 
"Strongly Disagree" to "Strongly Agree." Wilcoxon's paired T-tests compared individual students' ordinal rating of 
their current level of ability to their perceived need for competence that they anticipated their careers would 
require. Statistical significance was set at p < .01 . 

Results: Students' ratings ranged from "strongly disagree" to "strongly agree" that they could perform the 
defined GHD-related competencies. However, on most competencies, at least 50 % of students indicated that 
the stated competencies were beyond their present ability level. For each competency, the results of Wilcoxon 
paired T-tests indicate - at statistically significant levels - that students perceive more need in their careers for 
GHD-program defined competencies than they currently possess. 

Conclusion: This study suggests congruence between student and program perceptions of the scope of 
practice required for GHD. Students report the need for enhanced skill levels in the careers they anticipate. This 
approach to formulating and reflecting on competencies will guide the program's design of learning 
experiences aligned with students' career goals. 
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Background 

In "Education of health professionals for the 21 st century, " 
Lancet featured an international commission's report that 
cited glaring gaps and inequities in health and health care 
outcomes, within and across nations, as constituting the 
most dramatic and incontrovertible evidence of the need 
to reform health education [1]. To achieve the health pro- 
fession's potential for ameliorating health disparities, the 
Commission recommended profound health education re- 
form, moving it from the tradition of informative learning, 
focused on transmitting knowledge and skills to produce 
experts, and beyond formative learning, which focuses on 
socializing students around values to produce competent 
professionals. Instead, the Commission urges us to cham- 
pion transformative learning, which focuses on developing 
leadership competencies intended to produce enlightened 
change agents capable of creatively adapting global re- 
sources to address priorities in local needs. 

The proposed health professions education reform for 
ameliorating health disparities comes at a time when we 
can build on existing and emerging knowledge about con- 
ceptual frameworks for understanding global health [2] 
and health disparities [3], translational research practices 
bringing the potential for preventing or alleviating suffer- 
ing into communities [4], educational practices fostering 
health professionals' responsive leadership skills, [5] and 
aspirations of medical students for acquiring expertise in 
ameliorating health care disparities [6] . 

Among the stakeholders influencing the design and 
evaluation of new medical school programs, medical edu- 
cation accreditation agencies hold considerable sway. Prior 
to 1998, medical education accreditation agencies focused 
their expectations on instructional objectives as a way for 
medical schools and residency programs to make explicit 
to trainees and to the public the knowledge, behaviors, 
and attitudes that the programs intended learners to ac- 
quire. Associated assessment measures echoed this focus, 
parsing measures of knowledge, skills, and attitudes [7]. 

Lessons learned from reviews of research conducted on 
attitudes of medical students and residents suggest cau- 
tions for current efforts intended to promote accountabil- 
ity of health education in preparing trainees to ameliorate 
disparities. Rezler characterized medical education re- 
search as often framing attitudes of trainees as a problem 
that medical education might hope to redress [8]. In this 
tradition of approaching the study of attitudes of profes- 
sionals in training as problems, studies of medical student 
and resident attitudes often documented declines in such 
valued professional orientations as altruism and empathy, 
with increases in cynicism, over the course of training. A 
recent review of longitudinal studies of empathy chal- 
lenges the empirical evidence underlying the accepted wis- 
dom about medical education's insidious role in eroding 
attitudes assumed to inspire compassionate care, including 



empathic care of vulnerable populations [9] . In this review, 
Colliver's re-analysis of the data showed that the extent of 
attitudinal changes to be slight and variable in direction. 
Colliver also challenged the construct validity of the mea- 
sures, which often used diffuse statements about attitudes. 

Medical schools have been urged to develop curricula in 
ways that are congruent with theories of motivating med- 
ical trainees' learning [10]. Notable among these theories is 
Self-Determination theory, which emphasizes adults' needs 
for competency, autonomy, and relationships [11]. A con- 
current critique of existing research on self-assessment 
recommends that medical education adopt approaches 
more aligned with promoting learners' reflection and self- 
directed assessment seeking [12]. 

Although accreditation agencies have moved to an em- 
phasis on competencies to promote accountability, medical 
educators caution that the very general characterizations of 
competencies left important work to be done for meaning- 
ful curriculum development and associated assessment, in- 
cluding grounding expectations for training in the context 
of real work responsibilities [13], and making explicit the 
likely scope of practice [14]. 

Particularly for competencies not represented in trad- 
itional medical education, the scope of practice might not 
be explicit and might not be consistendy valued as defini- 
tive and necessary, especially for trainees with limited ac- 
cess to role models in emerging scopes of practice. For 
example, in the Canadian (CanMEDS) accreditation sys- 
tem, advocacy (defined as physicians responsibly using 
"their expertise and influence to advance the health and 
well-being of individual patients, communities, and popu- 
lations)" constitutes an explicit expectation for every mem- 
ber in the profession [15]. In the U.S. Accreditation for 
Graduate Medical Education (ACGME), advocacy is not 
explicitly defined as a goal of training for which a training 
program would be held accountable. Responses to Earnest's 
[16] call to make advocacy, defined as "action by a physician 
to promote those social, economic, educational, and polit- 
ical changes that ameliorate the suffering and threats to hu- 
man health and well-being that he or she identifies through 
his or her professional work and expertise" evoked mark- 
edly divergent responses, including protests that promoting 
advocacy would distort medical education [17]. 

Despite this ambivalence, medical schools are increas- 
ingly moving to provide instruction relevant to ameliorating 
global and domestic health disparities. A recent review of 
structured global health education programs in U.S. med- 
ical schools concluded that there was little standardization 
across programs in terms of their requirements for didactic, 
clinical, scholarly, and cultural components [18]. In this 
emerging field, the development of a self-assessment meas- 
ure for capturing students' skills and career aspirations for 
their roles could inform our collective ability to develop 
and evaluate responsive curricula. 
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In this study, we explore the insights drawn from a 
competency-based approach to assessing medical stu- 
dents' perceptions of their level of competency related to 
practice in ameliorating disparities in domestic and global 
health settings. We elicit the level of competency students 
see themselves as bringing to the table as they initiate par- 
ticipation in a co-curricular medical school pathway, and 
compare this to the level of competency they perceive that 
their future careers will need. Our study questions were: 

• what level of ability do medical students perceive 
themselves as having in defined competencies 
related to alleviating disparities, as they begin 
training for their careers? 

• what level of ability do medical students perceive 
themselves as needing to have for their careers as 
physicians committed to alleviating disparities? 

Methods 

In 2010, the Senior Associate Dean for Education at the 
university-affiliated study site charged the Assistant Dean 
for Medical Education with developing a co-curricular 
"pathway of customized, self-regulated learning" in Global 
Health and Disparities. Explicit in this charge were the ex- 
pectations that the proposed program be aligned with the 
school's social mission and extend existing learning and 
leadership opportunities for medical students related to 
ameliorating disparities, both nationally and globally. In 
addition to this explicit delegation of responsibility, the 
school's administration also provided financial support 
equivalent to 10% full time equivalence to support the 
participation of a Director, six clinical faculty members, 
and a faculty member in medical education. The faculty 
members were experienced and actively involved in dis- 
parities research either in the U.S. or globally. 

Members met weekly over 18 months. Working groups 
also included more than three dozen medical students in- 
terested in global health and disparities. The faculty plan- 
ning group, working with students in an advisory role, 
reviewed existing research literature and publicly available 
descriptions of global health programs involving medical 
students. The planning group interviewed medical school 
faculty involved in applied global and domestic health care 
disparity work. Each faculty member was also encouraged 
to conduct informal key informant interviews with faculty 
from other colleges and universities that our medical stu- 
dents or planning faculty recommended for their leadership 
and active engagement in global health and disparities 
work. Each faculty member posted teaching resources for 
proposed competencies on a web-based site created for the 
project. A trained medical librarian with responsibility for 
supporting global health education and research at the 
study institution also conducted related searches of pub- 
lished resources, creating a dedicated information resource 



collection on our institution's website. To facilitate the 
planning group's curricular development efforts and planned 
student access to resources, the librarian also obtained in- 
stitutional licenses for potential textbooks recommended 
by the planning faculty, posting electronic access to the 
textbooks the Program Director proposed. These include: 
Medical management of vulnerable and underserved pop- 
ulations: Principles, practices, and populations [19]; Un- 
derstanding global health [20] and Vulnerable Populations 
in the United States [21]. 

We iteratively reviewed the set of competencies writ- 
ten or elicited by planning faculty members within the 
full planning group. Key sources for reviewing the pro- 
posed set of competencies also included the potential 
teaching resources posted on the group's website. We 
piloted the statements of competencies for clarity and 
perceived importance with separate groups of first-year 
and fourth-year medical students working with our ad- 
visory group, with a subsequent review of the statements 
for clarity with a group of 12 clinical faculty members 
from diverse medical fields enrolled in our institution's 
Medial Education Scholars Program We modified and 
synthesized statements of the competencies into a final set 
of 16 competency statements. 

In 2012, 32 first-year medical students were admitted into 
a newly developed Global Health and Disparities (GHD) 
Path of Excellence. The GHD program is a set of mentored 
co-curricular activities built around defined competencies 
related to professional development and leadership skills to 
ameliorate health disparities in the United States and devel- 
oping countries. To promote student reflection and inform 
the design of responsive educational curriculum, we asked 
our entering cohort to review the statements of competen- 
cies from two perspectives. First, GHD students rated their 
ability to perform the identified competencies that they per- 
ceived themselves as holding as they began their participa- 
tion in the GHD program. Second, students identified the 
extent to which they considered their future career would 
require these responsibilities. For students' assessments of 
both the level of capability they held as they entered the 
program and the extent to which their career would re- 
quire these competencies, the response scale ranged from 
"Strongly Disagree" to "Strongly Agree." Our institutional 
review board determined that this educational research 
qualified for human subjects exemption status. Our statis- 
tical analyses comparing students' ordinal-level ratings of 
their current level of competence to the level they perceived 
they would need in their future career used Wilcoxin's 
paired T-tests, with statistical significance set at p<. 01. 

Results 

Tables 1 though 4 summarize the distribution of ratings 
from UM students accepted into the GHD program, in 
terms of the students' self-assessed ability to now perform 
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Table 1 Percent of students reporting current ("Now") and needed ("Career Need") competence in GHD-related 
competencies (n = 32) 

% of students 



Strongly Disagree Agree Strongly Wilcoxin s paired 
disagree agree T-value 



Now 6 34 56 3 4.5* 

Career Need - 3 41 56 

Now 6 38 56 - 4.4* 

Career Need - 6 25 69 

Now - 50 41 9 3.9* 

Career Need - 6 34 59 

Now 28 47 19 6 4.7* 

Career Need - 3 34 63 

Now - 25 66 9 4.6* 

Career Need - 25 75 



Domain: social determinants of health 



Identify and apply frameworks describing the impact of society on 
the health of vulnerable populations, including differential distribution 
of diseases, risk factors, and health care access and delivery. 

Identify opportunities to affect societal determinants of health, 
drawing on approaches successfully used in ameliorating 
health disparities. 

Identify and employ strategies for resolving ethical issues 
arising in efforts to address health care disparity. 

Identify sources for funding research in health disparities, 
both domestically and internationally. 

Demonstrate cultural competence in learning and in developing 
and implementing programs related to health disparities. 

***P Value < .005. 

defined competencies related to GHD, compared to the 
level of competence they believe their career will require. 

Ratings of current level of competencies within domains 

Within the domain of Social Determinants of Health 
(Table 1), the competencies most students perceived them- 
selves as being able to do related to demonstrating cultural 
competence (75% of students agreed/strongly agreed.) 
About half (59%) of the students characterized themselves 
as being able to identify and apply frameworks describing 
the impact of society on the health of vulnerable popula- 
tions. In terms of being able to identify and use strategies 
to resolve ethical issues arising from efforts to address 
health care disparity, half of the GHD students thought 
they could do so; half indicated that could not. A majority 
(75%) felt that they could not presently identify sources for 
funding research in health disparities. 

In contrast, fewer students rated their abilities related to 
health care systems and policy as responsibilities they 
could conduct (Table 2). Half of the students felt that they 
could identify and compare health systems in the U.S. and 
in a developing country, in terms of their use of organized 
and informal sectors; half could not. About half (47%) of 
the students felt that they could compare and contrast the 
role of non-governmental and governmental organizations 
in mitigating health disparities and improving health out- 
comes; 53% indicated they could not. Less than half of the 
students (43%) considered that they could compare and 
contrast health policies, priorities, and resources in differ- 
ent regions or nations. Only a third of students felt that 
they could use a range of health information systems to 
inform their work in populations with health disparities. 

Table 3 summarizes students' ratings of their level of 
competence related to strategies to promote sustainable 



change. Defining sustainability was the only competency 
within this domain that elicited ratings from even a slight 
majority (62%) of students indicating that they could do it. 
Less than half (40%) of students felt that they understood 
health communication methods and technologies for im- 
proving health behavior and outcomes. Most (81%) of stu- 
dents characterized themselves as currently unable to 
critically review and analyze elements of successful capacity 
building in the context of a health disparities problem. 

In terms of students' professional and leadership devel- 
opment (shown in Table 4), students were almost evenly 
split in characterizing their current ability levels. About 
half (51%) characterized themselves as currently under- 
standing organizational leadership, including working with 
teams and aligning projects with institutional missions. 
Somewhat fewer students (41%) characterized themselves 
as currently able to formulate a plan for their personal on- 
going involvement, career advancement, and training in 
the field of health disparities. 

Ratings across domains of competence 

Across domains, on 10 of the 16 competencies, student's 
ratings ranged across the full spectrum of "strongly dis- 
agree" to "strongly agree" that they could perform the de- 
fined GHD-related competencies. However, on most (11) 
of the 16 competencies, at least 50% of students "dis- 
agreed" or "strongly disagreed" that they could perform 
the stated competence, which indicated that the stated 
competencies were beyond their present ability level. 

Competency statements most often eliciting student rat- 
ings that they "disagreed" or "strongly disagreed" that they 
now could perform the proposed GHD-related responsi- 
bility included: describing and implementing key steps in 
program development and evaluation; identifying effects 
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Table 2 Percent of students reporting current ("Now") and needed ("Career Need") competence in GHD-related 
competencies (n = 32) 



Domain: health care systems and policy 



Strongly 
disagree 



% of students 
Disagree Agree 



Strongly 
agree 

4 



Wilcoxin's paired 
T-value 



Compare and contrast health policies, 
priorities, and resources in different 
regions or nations. 

Compare and contrast the roles of 
non-governmental and governmental 
organizations in mitigating health disparities 
and improving health outcomes. 

Identify and compare health systems in the 
U.S. and in a developing country, in terms of 
their use of organized and informal sectors. 

Identify and demonstrate your ability to use 
a range of health information systems to 
inform your work in populations with 
health disparities. 



Now 

Career Need 
Now 

Career Need 
Now 

Career Need 
Now 

Career Need 



12 



44 

9 

47 
6 

41 

18 

50 
6 



34 
28 

41 

22 

41 

38 

34 
32 



62 

6 
72 

9 
44 

61 



4.0* 



4.4* 



3.3* 



4.4* 



*P Value < .005. 



of internal-external health partnership on the target com- 
munity as a whole, beyond the immediate intended health 
effects; identifying sources for funding research in health 
disparities, both domestically and internationally; critically 
reviewing and analyzing elements of successful capacity 
building in the context of a health disparities problem; 
identifying and demonstrating one's ability to use health 
information sources to inform work in populations experi- 
encing health disparities; presenting a plan for personal 
ongoing involvement, career advancement, and training in 
health disparities. 



In contrast, at least 50% of GHD students reported that 
they "agreed" that they could now: identify and employ 
strategies for resolving ethical issues arising in efforts to 
address health care disparity; demonstrate understanding 
of organizational leadership, including leadership styles 
and strategies, working with teams, and aligning projects 
with institutional missions; demonstrate cultural compe- 
tence in your learning and in developing and implement- 
ing programs related to health disparities; identify and 
compare health systems in the U.S. and in a developing 
country, in terms of their use of organized and informal 



Table 3 Percent of students reporting current ("Now") and needed ("Career Need") competence in GHD-related 
competencies (n = 32) 









% of students 






Domain: strategies to promote sustainable change 




Strongly 
disagree 


Disagree 


Agree 


Strongly 
agree 


Wilcoxin's paired 
T-value 






1 


2 


3 


4 




Describe and implement key steps in program development and 
evaluation, including needs assessment, identifying health markers 
and project resources, community and stakeholder engagement, 
monitoring program implementation, and identifying program impact. 


Now 

Career Need 


25 


66 
9 


9 

34 


56 


49 *« 


Identify effects of a specific internal-external health partnership 
on the target community as a whole, beyond the immediate 
intended health effects. 


Now 

Career Need 


12 


72 
6 


16 
41 


53 


4.8*** 


Define sustainability, how it can be measured, and apply 
at least one element to a health disparities project to 
enhance its sustainability. 


Now 

Career Need 


3 


34 
9 


56 
50 


6 
'11 


3.2*** 


Critically review and analyze elements of successful capacity 
building in the context of a health disparities problem. 


Now 

Career Need 


6 


75 
6 


16 
68 


3 

26 


4.6*** 


Demonstrate understanding of health communication 
methods and technologies for improving health 
behavior and outcomes. 


Now 

Career Need 


3 


56 
3 


34 
34 


6 
62 


4.4*** 



*P Value < .005. 
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Table 4 Percent of students reporting current ("Now") and needed ("Career Need") competence in GHD-related 
competencies (n = 32) 



% of students 



Domain: professional and leadership development 




Strongly 
disagree 


Disagree 


Agree 


Strongly 
agree 


Wilcoxin's paired 
T-value 






1 


2 


3 


4 




Demonstrate understanding of organizational leadership, 


Now 


3 


45 


48 


3 


44 *»* 


including leadership styles and strategies, working with 
teams, and aligning projects with institutional missions. 


Career Need 






38 


62 




Present a plan for personal ongoing involvement, 


Now 


9 


50 


38 


3 


42 »* 


career advancement, and training in the field 
of health disparities. 


Career Need 


3 


3 


28 


66 





P Value < .005. 



sectors; define sustainability, how it can be measured, and 
apply at least one element to a health disparities project to 
enhance its sustainability; identify opportunities to affect 
societal determinants of health, drawing on approaches 
successfully used in ameliorating health disparities; and 
identify and apply frameworks describing the impact of so- 
ciety of the health of vulnerable populations, including dif- 
ferential distribution of diseases, risk factors, and health 
care access and delivery. 

Ratings of anticipated need for GHD-related competencies 
in their career 

For 15 of the 16 defined competencies, 90% of the GHD 
student-participants "agreed" or "strongly agreed" that their 
careers would require them to be able to conduct the de- 
fined competency. The sole exception was the ability to 
identify and compare health systems in the U.S. and in a 
developing country, in terms of their use of organized and 
informal sectors, as 18% of students "disagreed" that their 
career would require this competency. 

All (100%) of GHD students characterized their careers 
as requiring competence in both organizational leadership 
and in cultural competence as they work to develop and 
implement program related to health disparities. Only two 
students "disagreed" or "strongly disagreed" that their fu- 
ture careers would require them to formulate a plan for 
personal ongoing involvement, career advancement, and 
training in the field of health disparities. In contrast, 93.3% 
of GHD students "agreed" or "strongly agreed" their future 
careers would require them to develop such personal de- 
velopment and career planning. 

Comparison of current ability to perceived need for 
GHD-related competencies 

Each table summarizes the results of statistical analyses 
(Wilcoxin's paired T-test, the nonparametric equivalent to 
the paired t-test statistical analysis) comparing individual 
students' rating of their current level of ability to their per- 
ceived need for competence that they anticipate their car- 
eer will require. 



For each of the 16 competencies, the results of Wilcoxin 
paired T-test values indicate that students perceive more 
need in their careers for the GHD-program defined com- 
petencies than they currently possess, at statistically sig- 
nificantly levels. 

Discussion and conclusion 

In this study, we explored the use of explicit competencies 
to promote medical students' reflection on the depth and 
scope of global health equity related expertise. While the 
results show that some students characterize themselves as 
already having at least some ability to conduct these com- 
petencies, the findings also indicate that students see the 
need for higher levels of skills in the careers they anticipate. 
The finding that the GHD founding student cohort rated 
the full set of potential competencies as germane to the ca- 
reers they anticipate suggests considerable congruence be- 
tween student and faculty perceptions of the scope of 
practice required for GHD. 

Limitations of this study include that it reflects its use in 
a single study institution. The methods for identifying 
competencies drew on the resources of faculty involved in 
global and domestic health disparities research, who re- 
ceived institutionally supported time for their efforts in 
developing the curriculum and associated assessments. Al- 
though we sought to extend what we could build from 
drawing on their expertise with reviews of literature and 
informal key informant interviews with colleagues from 
other schools and professions, the collegial building of the 
network of faculty who would continue to work on the 
project would be less appropriate for global health cur- 
riculum development intended to minimize the influence 
of faculty perceived to have more expertise and authority, 
for which such methods as the Delphi approach to an- 
onymously gathering and reviewing formal ratings of pri- 
orities would be appropriate. In addition, although the 
pilot-testing of the assessment instrument for clarity in- 
cluded medical school faculty not involved in global 
health, the findings obtained in this study draw on the in- 
strument's use with a special group of medical students in- 
terested in pursing global health and disparities training, 
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so the findings might not be generalizable to other popula- 
tions. We also recognize that students' self-assessments of 
their competence in cultural competence can't be consid- 
ered evidentiary of their actual ability to practice, but rec- 
ognizing their perception can inform the ways that we 
develop curriculum to test and enhance their skills. Fur- 
ther, the small number of students involved in our entry 
cohort of GHD students precludes the use of factor ana- 
lysis, the statistical analysis that could be used to confirm 
the clustering/organization of competencies within such 
construct domains as leadership and social determinants 
of health. Despite the relatively small number of students 
involved, the magnitude of the effect size was sufficiently 
large that the comparison of current and needed compe- 
tency was statistically significant. 

Our program evaluation approach (formulating GHD- 
related practice competencies and eliciting students' per- 
ceived current level of ability and the level of ability their 
future careers will require) provides several advantages. 
First, we believe that this practice promotes reflection - of 
both the faculty and students - about the scope of practice 
that could inspire student's instruction. This is an import- 
ant consideration, particularly in developing expertise re- 
quired for careers that have not historically been a focus 
of medical training programs. Second, this approach pro- 
vided empirical evidence that some GHD students already 
perceived themselves as having significant training and ex- 
perience related to GHD competencies. This recognition 
influenced our curriculum's development of mentored 
learning activities that students with existing commitment, 
training, and experience related to GHD competencies 
could lead. This informed curriculum design decisions to 
make most large group didactic sessions optional, give 
greater emphasis to case-based discussion groups for which 
students rotated leadership roles, and conduct and report 
on focused field work based on topics small groups of stu- 
dents selected. 

The practice of eliciting students' perceptions of their 
current level of skills can inform the program about skills 
students perceive that they already command. 

Both curricular programs and their associated assessment 
systems can draw on the theoretical framework of Self- 
Determination Theory, for which strong empirical research 
support exists, across patient and professional health edu- 
cation applications [22]. Existing research has shown that 
training programs that provide medical students and resi- 
dents with opportunities for informed advocacy can have 
important health amelioration outcomes [23,24]. 

Medical education programs promoting reflection of 
medical students drawn to these programs are consistent 
with theories of learning and motivation for medical pro- 
fessionals [10,22]. Such approaches can inform responsive 
curriculum development and career planning that sustains 
inspirations for advocacy in medical careers. 
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